Head-mounted Display Technology Research Articles

Comparing a virtual reality head-mounted display to on-screen three-dimensional visualization and two-dimensional computed tomography data for training in decision making in hepatic surgery: a randomized controlled study.

Evaluation of the benefits of a virtual reality (VR) environment with a head-mounted display (HMD) for decision-making in liver surgery. Training in liver surgery involves appraising radiologic images and considering the patient's clinical information. Accurate assessment of 2D-tomography images is complex and requires considerable experience, and often the images are divorced from the clinical information. We present a comprehensive and interactive tool for visualizing operation planning data in a VR environment using a head-mounted-display and compare it to 3D visualization and 2D-tomography. Ninety medical students were randomized into three groups (1:1:1 ratio). All participants analyzed three liver surgery patient cases with increasing difficulty. The cases were analyzed using 2D-tomography data (group "2D"), a 3D visualization on a 2D display (group "3D") or within a VR environment (group "VR"). The VR environment was displayed using the "Oculus Rift ™" HMD technology. Participants answered 11 questions on anatomy, tumor involvement and surgical decision-making and 18 evaluative questions (Likert scale). Sum of correct answers were significantly higher in the 3D (7.1 ± 1.4, p < 0.001) and VR (7.1 ± 1.4, p < 0.001) groups than the 2D group (5.4 ± 1.4) while there was no difference between 3D and VR (p = 0.987). Times to answer in the 3D (6:44 ± 02:22min, p < 0.001) and VR (6:24 ± 02:43min, p < 0.001) groups were significantly faster than the 2D group (09:13 ± 03:10min) while there was no difference between 3D and VR (p = 0.419). The VR environment was evaluated as most useful for identification of anatomic anomalies, risk and target structures and for the transfer of anatomical and pathological information to the intraoperative situation in the questionnaire. A VR environment with 3D visualization using a HMD is useful as a surgical training tool to accurately and quickly determine liver anatomy and tumor involvement in surgery.

A comparison between augmented reality and traditional in-person teaching for vascular anastomotic surgical skills training

BackgroundAugmented reality (AR) superimposes computer-generated content to a real-world environment through multitudinous devices, and is used across multiple training fora. Its use in vascular surgery education is yet to be formally investigated. The aim is to assess feasibility and effectiveness of remote teaching of vascular anastomosis skills enhanced by AR in the form of the HoloLens2 Head-Mounted Display technology with traditional in-person skills teaching. A remote trainer used video, gestures and images superimposed over participants' field of vision via the HoloLens2 to teach the skills. MethodsTwenty-eight participants underwent a preassessment performing an end-to-end vascular anastomosis on an artificial vessel. They were allocated randomly to an AR or in-person group, and underwent two teaching sessions. Individuals were asked to complete a postsession feedback form and assessment (video recorded and anonymized). The videos were marked by two blinded, independent assessors using the Objective Structured Assessment of Technical Skills (OSATS) scoring. ResultsThere was an overall improvement in both cohorts in OSATS score after the intervention by +7.083 in the in-person group and +8.275 in the AR. Independent t test was performed and a P value of .422 was obtained, indicating no statistically significant difference in the change in OSATS scores when comparing the skills teaching received in-person with that through AR. ConclusionsRemote teaching enhanced by AR is feasible and effective for the teaching of vascular surgical anastomosis skills and noninferior to in-person teaching. There is scope for development of the use of AR in vascular surgical skills training.

Visual inspection with augmented reality head‐mounted display: An Australian usability case study

AbstractAugmented reality (AR) is an Industry 4.0 technology. For more than a decade, advancements in AR technology and their applications have been expected to revolutionise the manufacturing industry and deliver quality and productivity gains. However, due to factors such as equipment costs, skills shortages and technological limitations of AR devices, operational deployment beyond prototypes has been constrained. Real‐world, usability studies can explore barriers to implementation and improve system design. This paper details a mixed method usability case study of an AR head‐mounted display (HMD) to perform a short, simple visual inspection task. Twenty‐two participants from South Australian manufacturing businesses inspected a pump and pipe skid while working at height. Overall, workload demands for the task were considered acceptable and just below the “low” workload threshold (NASA Task Load Index, mean = 29.3) and the system usability was rated “average” (system usability scale, mean = 68.5). The results suggest the task did not place too high a burden on users and was an appropriate initial exposure to AR HMDs, but further refinement to the interface would be desirable before implementation to minimise frustration and promote learning. Users were enthusiastic and open‐minded about the AR HMD although results indicate that even with recent advancements in AR HMD technology, interactions between the task, technology and environment continue to cause human and technical challenges—some of which are relatively straightforward to address but others are dependent on larger‐scale efforts.

Game on: immersive virtual laboratory simulation improves student learning outcomes & motivation.

The use of gamified learning interventions is expanding in postsecondary education as a means to improve students' motivation and learning outcomes. Virtual laboratory simulations have been used in science education to supplement students' learning, as well as to increase engagement with course material. Due to COVID-19, many instructors sought to replace or supplement hands-on 'wet-lab' work in an online environment. In this paper, we explored how the use of head-mounted display technology in two laboratory simulations impacts learner motivation and learning outcomes. We used a mixed-methods approach to analyze the experience of 39 undergraduate participants, examining test scores pre- and postsimulation, qualitative feedback, and quantitative experience ratings. The head-mounted display technology was described as easy to use, with eye strain identified as a common occurrence. Participants had increased test scores following the laboratory simulations, with no significant difference between simulation groups. Very positive self-reported measures of motivation and learner engagement were documented. Ninety-one percent of participants agreed that virtual reality laboratory simulation would be a good supplement to regular teaching modalities. Overall, our results suggest that immersive virtual reality laboratory simulations experienced through head-mounted display technology can be used to enhance learning outcomes and increase learner motivation.

Mixed Reality in Modern Surgical and Interventional Practice: Narrative Review of the Literature.

Mixed reality (MR) and its potential applications have gained increasing interest within the medical community over the recent years. The ability to integrate virtual objects into a real-world environment within a single video-see-through display is a topic that sparks imagination. Given these characteristics, MR could facilitate preoperative and preinterventional planning, provide intraoperative and intrainterventional guidance, and aid in education and training, thereby improving the skills and merits of surgeons and residents alike. In this narrative review, we provide a broad overview of the different applications of MR within the entire spectrum of surgical and interventional practice and elucidate on potential future directions. A targeted literature search within the PubMed, Embase, and Cochrane databases was performed regarding the application of MR within surgical and interventional practice. Studies were included if they met the criteria for technological readiness level 5, and as such, had to be validated in a relevant environment. A total of 57 studies were included and divided into studies regarding preoperative and interventional planning, intraoperative and interventional guidance, as well as training and education. The overall experience with MR is positive. The main benefits of MR seem to be related to improved efficiency. Limitations primarily seem to be related to constraints associated with head-mounted display. Future directions should be aimed at improving head-mounted display technology as well as incorporation of MR within surgical microscopes, robots, and design of trials to prove superiority.

Design of Smart Head–Mounted Display Technology: A Convergent Mixed-Methods Study

Introduction: The purpose of this study was to characterize functional impairments and human factor considerations that affect perceptions and preferences for head-mounted display (HMD) technology for adults with low vision and chronic eye disease. Methods: Through a convergent mixed-methods design, participants with visual impairments (age-related macular degeneration, diabetic retinopathy, glaucoma, or retinitis pigmentosa) were recruited. Participants completed the Impact of Vision Impairment (IVI) questionnaire, used commercially available HMDs (eSight, NuEyes, and Epson Moverio), and were interviewed. The IVI was used to identify groups with low, moderate, and high vision–related quality of life (VRQOL). Transcribed interviews were analyzed using a thematic approach. The survey and qualitative findings were integrated using mixed-methods joint display analysis. Results: Twenty-one participants were enrolled (mean age of 58.2 years, 57% male, median Snellen acuity of 20/40 [range: 20/20–hand movement]). An equal number ( n = 9) expressed a preference for eSight and NuEyes, while ( n = 3) preferred the Moverio. Participants emphasized ease of use, including HMD controls and screen, as common reasons for preference. Those with lower IVI well-being scores preferred eSight due to vision improvement. Those with moderate IVI well-being scores preferred NuEyes due to comfort and size. Those with high IVI well-being scores cited usability as the most important feature. Discussion: User preferences for HMD features were associated with VRQOL. A mixed-methods approach explained how varying degrees of visual impairment and HMD preferences were qualitatively related to usability at the individual level. Implications for Practitioners: To increase acceptance, new HMD development for low vision should focus on performance, usability, and human factors engineering. Although HMD technology can benefit individuals with low vision, device features and functions vary in meaningful ways based on vision parameters. Practitioners should be aware of how patient and device variations influence preferences when they recommend wearable systems and optimize training to harness these systems.

Immersing learners in stories: A systematic literature review of educational narratives in virtual reality

The aim of this study, via a systematic review, was to investigate the addition of narratives in immersive virtual reality (IVR) and the associated impacts on learning. Narratives in IVR put the learner in the story, which, until recent developments in IVR head-mounted display technology, was out of reach in most classrooms. The review found that added immersion afforded by VR is particularly important in relation to learning where situational context is desirable. Importantly, IVR experiences with a narrative may have the potential to increase affective outcomes for learners, without reducing cognitive gains. Additionally, data concerning learning theories and design methodologies was extracted from the studies. The systematic review yielded 12 relevant and applied papers with this demonstrating there are still significant gaps in the research concerning the impact on learning in narrative IVR. This review highlights that the inclusion of narratives in educational IVR offers many potential benefits, however is yet to be fully explored. There are endless opportunities to tell stories in IVR. How they can be used and their impact on education is a rich ground for further research and development. Implications for practice or policy Educators and VR developers should consider including a narrative in an educational IVR experience because of the potential to increase affective outcomes such as motivation and engagement, without reducing cognitive gains. Learners can benefit from educational IVR experiences with narratives because they can provide situational context, elicit an emotional response and scaffold complex learning.

Recognition of Attentional States in VR Environment: An fNIRS Study.

An improvement in ecological validity is one of the significant challenges for 21st-century neuroscience. At the same time, the study of neurocognitive processes in real-life situations requires good control of all variables relevant to the results. One possible solution that combines the capability of creating realistic experimental scenarios with adequate control of the test environment is virtual reality. Our goal was to develop an integrative research workspace involving a CW-fNIRS and head-mounted-display (HMD) technology dedicated to offline and online cognitive experiments. We designed an experimental study in a repeated-measures model on a group of BCI-naïve participants to verify our assumptions. The procedure included a 3D environment-adapted variant of the classic n-back task (2-back version). Tasks were divided into offline (calibration) and online (feedback) sessions. In both sessions, the signal was recorded during the cognitive task for within-group comparisons of changes in oxy-Hb concentration in the regions of interest (the dorsolateral prefrontal cortex-DLPFC and middle frontal gyrus-MFG). In the online session, the recorded signal changes were translated into real-time feedback. We hypothesized that it would be possible to obtain significantly higher than the level-of-chance threshold classification accuracy for the enhanced attention engagement (2-back task) vs. relaxed state in both conditions. Additionally, we measured participants′ subjective experiences of the BCI control in terms of satisfaction. Our results confirmed hypotheses regarding the offline condition. In accordance with the hypotheses, combining fNIRS and HMD technologies enables the effective transfer of experimental cognitive procedures to a controlled VR environment. This opens the new possibility of creating more ecologically valid studies and training procedures.

Developing Virtual Reality Head Mounted Display (HMD) Set-Up for Thoracoscopic Surgery of Complex Congenital Lung MalFormations in Children.

Video assisted thoracoscopic surgery (VATS) has been adopted in pediatric age for the treatment of congenital lung malformations (CLM). The success of VATS in pediatrics largely depends on the surgeon’s skill ability to understand the airways, vascular system and lung parenchyma anatomy in CLM. In the last years, virtual reality (VR) and 3-dimensional (3D) printing of organ models and VR head mounted display (HMD) technologies have been introduced for completion of preoperative planning in adult patients. To date no reports about the use of VR HMD technologies in a pediatric setting are available. The aim of this report is to introduce a VR HMD model in VATS procedure to improve the quality of care in children with CLM. VR HMD set-up for planning thoracoscopic surgery was performed in a series of pediatric patients with diagnosis of CLM. The preoperative VR HMD evaluation allowed a navigation into the malformation with the aim to explore, interact, and make the surgeon more confident and skilled to answer to the traps. A development of surgical simulations models and teaching program dedicated to education and training in pediatric VATS is suitable among the pediatric surgery community. Further studies should demonstrate all the benefits of such technology in pediatric patients submitted to VATS procedure.

Head-mounted digital metamorphopsia suppression as a countermeasure for macular-related visual distortions for prolonged spaceflight missions and terrestrial health.

During long-duration spaceflight, astronauts are exposed to various risks including spaceflight-associated neuro-ocular syndrome, which serves as a risk to astronaut vision and a potential physiological barrier to future spaceflight. When considering exploration missions that may expose astronauts to longer periods of microgravity, radiation exposure, and natural aging processes during spaceflight, more severe changes to functional vision may occur. The macula plays a critical role in central vision and disruptions to this key area in the eye may compromise functional vision and mission performance. In this article, we describe the development of a countermeasure technique to digitally suppress monocular central visual distortion with head-mounted display technology. We report early validation studies with this noninvasive countermeasure in individuals with simulated metamorphopsia. When worn by these individuals, this emerging wearable countermeasure technology has demonstrated a suppression of monocular visual distortion. We describe the considerations and further directions of this head-mounted technology for both astronauts and aging individuals on Earth.

Evaluation of photography using head-mounted display technology (ICAPS) for district Trachoma surveys.

BackgroundAs the prevalence of trachoma declines worldwide, it is becoming increasingly expensive and challenging to standardize graders in the field for surveys to document elimination. Photography of the tarsal conjunctiva and remote interpretation may help alleviate these challenges. The purpose of this study was to develop, and field test an Image Capture and Processing System (ICAPS) to acquire hands-free images of the tarsal conjunctiva for upload to a virtual reading center for remote grading.Methodology/Principal findingsThis observational study was conducted during a district-level prevalence survey for trachomatous inflammation—follicular (TF) in Chamwino, Tanzania. The ICAPS was developed using a Samsung Galaxy S8 smartphone, a Samsung Gear VR headset, a foot pedal trigger and customized software allowing for hands-free photography. After a one-day training course, three trachoma graders used the ICAPS to collect images from 1305 children ages 1–9 years, which were expert-graded remotely for comparison with field grades. In our experience, the ICAPS was successful at scanning and assigning barcodes to images, focusing on the everted eyelid with adequate examiner hand visualization, and capturing images with sufficient detail to grade TF. The percentage of children with TF by photos and by field grade was 5%. Agreement between grading of the images compared to the field grades at the child level was kappa = 0.53 (95%CI = 0.40–0.66). There were ungradable images for at least one eye in 199 children (9.1%), with more occurring in children ages 1–3 (18.5%) than older children ages 4–9 (4.2%) (χ2 = 145.3, p<0.001).Conclusions/SignificanceThe prototype ICAPS device was robust, able to image 1305 children in a district level survey and transmit images from rural Tanzania to an online grading platform. More work is needed to improve the percentage of ungradable images and to better understand the causes of disagreement between field and photo grading.

A-134 Agile Development of Virtual Reality Treatment for Spatial Neglect: Preliminary Usability and Feasibility

Abstract Objective Examine the usability and feasibility of a virtual reality (VR) treatment for persons with spatial neglect using head mounted display (HMD) and hand tracking technologies. Method Recruited from a rehabilitation hospital, 9 stroke survivors with spatial neglect (3 females; mean age = 64.2 years, SD = 9.1; 8 left neglect) participated in user testing for ongoing software development. Participants tested one of four customized treatment modules and completed the System Usability Scale, the Presence Questionnaire, and the Simulator Sickness Questionnaire. Feedback from participants were integrated into iterative prototype revisions. Module 1 (n = 7) required arm movements gradually reaching toward the neglected side of space, while the virtual hand appeared reaching straight ahead. Module 2 (n = 4) required head movements from the non-neglected to the neglected side. Module 3 (n = 6) involved head and arm movements towards both sides of space to collect objects. Module 4 (n = 2) was to stop approaching objects from a distance ahead. Results Despite reporting a lack of realism, participants preferred VR over conventional therapy. Participants felt comfortable and confident engaging in the virtual environment. Module 4 was more difficult than the other modules as participants required more practice to perform the task. Two participants reported Module 3 being tiresome, with one reporting mild shoulder pain and eye strain, and moderate sweating. However, all reported symptoms were temporary and resolved following a short break. Conclusion VR-based rehabilitation for spatial neglect using HMD and hand tracking technologies may be a viable treatment option for stroke survivors with spatial neglect. The modules benefited substantively from modifications based on participants’ feedback.

Bringing full-featured mobile phone interaction into virtual reality

Virtual Reality (VR) Head-Mounted Display (HMD) technology immerses a user in a computer generated virtual environment. However, a VR HMD also blocks the users’ view of their physical surroundings, and so prevents them from using their mobile phones in a natural manner. In this paper, we present a novel Augmented Virtuality (AV) interface that enables people to naturally interact with a mobile phone in real time in a virtual environment. The system allows the user to wear a VR HMD while seeing his/her 3D hands captured by a depth sensor and rendered in different styles, and enables the user to operate a virtual mobile phone aligned with their real phone. We conducted a formal user study to compare the AV interface with physical touch interaction on user experience in five mobile applications. Participants reported that our system brought the real mobile phone into the virtual world. Unfortunately, the experiment results indicated that using a phone with our AV interfaces in VR was more difficult than the regular smartphone touch interaction, with increased workload and lower system usability, especially for a typing task. We ran a follow-up study to compare different hand visualizations for text typing using the AV interface. Participants felt that a skin-colored hand visualization method provided better usability and immersiveness than other hand rendering styles.

Head-Mounted Display-Based Application for Cognitive Training.

Virtual Reality (VR) has had significant advances in rehabilitation, due to the gamification of cognitive activities that facilitate treatment. On the other hand, Immersive Virtual Reality (IVR) produces outstanding results due to the interactive features with the user. This work introduces a VR application for memory rehabilitation by walking through a maze and using the Oculus Go head-mounted display (HMD) technology. The mechanics of the game require memorizing geometric shapes while the player progresses in two modes, autonomous or manual, with two levels of difficulty depending on the number of elements to remember. The application is developed in the Unity 3D video game engine considering the optimization of computational resources to improve the performance in the processing and maintaining adequate benefits for the user, while the generated data is stored and sent to a remote server. The maze task was assessed with 29 subjects in a controlled environment. The obtained results show a significant correlation between participants’ response accuracy in both the maze task and a face–pair test. Thus, the proposed task is able to perform memory assessments.

Ability of Head-Mounted Display Technology to Improve Mobility in People With Low Vision: A Systematic Review.

PurposeThe purpose of this study was to undertake a systematic literature review on how vision enhancements, implemented using head-mounted displays (HMDs), can improve mobility, orientation, and associated aspects of visual function in people with low vision.MethodsThe databases Medline, Chinl, Scopus, and Web of Science were searched for potentially relevant studies. Publications from all years until November 2018 were identified based on predefined inclusion and exclusion criteria. The data were tabulated and synthesized to produce a systematic review.ResultsThe search identified 28 relevant papers describing the performance of vision enhancement techniques on mobility and associated visual tasks. Simplifying visual scenes improved obstacle detection and object recognition but decreased walking speed. Minification techniques increased the size of the visual field by 3 to 5 times and improved visual search performance. However, the impact of minification on mobility has not been studied extensively. Clinical trials with commercially available devices recorded poor results relative to conventional aids.ConclusionsThe effects of current vision enhancements using HMDs are mixed. They appear to reduce mobility efficiency but improved obstacle detection and object recognition. The review highlights the lack of controlled studies with robust study designs. To support the evidence base, well-designed trials with larger sample sizes that represent different types of impairments and real-life scenarios are required. Future work should focus on identifying the needs of people with different types of vision impairment and providing targeted enhancements.Translational RelevanceThis literature review examines the evidence regarding the ability of HMD technology to improve mobility in people with sight loss.

A Novel Automated Visual Acuity Test Using a Portable Head-mounted Display.

We developed a head-mounted display (HMD) as an automated way of testing visual acuity (VA) to increase workplace efficiency. This study raises its potential utility and advantages, analyzes reasons for its current limitations, and discusses areas of improvement in the development of this device. Manual VA testing is important but labor-intensive in ophthalmology and optometry clinics. The purpose of this exploratory study is to assess the performance and identify potential limitations of an automated HMD for VA testing. Sixty patients from National University Hospital, Singapore, were enrolled in a prospective observational study. The HMD was constructed based on the Snellen chart, with single optotypes displayed at a time. Each subject underwent VA testing of both eyes with the manual Snellen chart tested at 6 m from the subject and the HMD. Fifty-three subjects were included in the final analysis, with an incompletion rate of 11.7% (n = 7). The mean difference in estimated acuity between the HMD and Snellen chart was 0.05 logMAR. However, 95% limits of agreement were large at ±0.33 logMAR. The HMD overestimated vision in patients with poorer visual acuities. In detecting VA worse than 0.30 logMAR (6/12), sensitivity was 63.6% (95% confidence interval, 0.31 to 0.89%), and specificity was 81.0% (95% confidence interval, 0.66 to 0.91%). No significant correlation existed between mean difference and age (r = -0.15, P = .27) or education level (r = 0.04, P = .76). Advantages of our novel HMD technology include its fully automated nature and its portability. However, the device in its current form is not ready for widespread clinical use primarily because of its low accuracy, which is limited by both technical and user factors. Future studies are needed to improve its accuracy and completion rate and to evaluate for test-retest reliability in a larger population.

A Physiology-Based QoE Comparison of Interactive Augmented Reality, Virtual Reality and Tablet-Based Applications

The availability of affordable head-mounted display technology has facilitated new, potentially more immersive, interactive multimedia experiences. These technologies were traditionally focused on entertainment; however, academia and industry are now exploring applications in other domains such as health, learning and training. Key to the success of these new multimedia experiences is the understanding of a user's perceived quality of experience (QoE). Subjective user ratings have been the primary mechanism to capture insights into a user's experience. Such ratings have generally been captured post experience and reflected using a mean opinion score (MOS). However, user perception is multifactorial and subjective ratings alone do not express the true measure of an experience. As a result, recent efforts to capture QoE have included exploring the use of implicit metrics (e.g., physiological measures). This article presents the results of an experimental QoE evaluation and comparison of immersive applications delivered across three multimedia platforms. The platforms compared were augmented reality, tablet and virtual reality. The QoE methodology employed considered explicit (post-test questionnaire) and implicit (heart rate and electrodermal activity) assessment methods. The results indicate comparatively higher levels of QoE for users of the augmented reality and tablet platforms.

Joint effects of depth-aiding augmentations and viewing positions on the quality of experience in augmented telepresence

Virtual and augmented reality is increasingly prevalent in industrial applications, such as remote control of industrial machinery, due to recent advances in head-mounted display technologies and low-latency communications via 5G. However, the influence of augmentations and camera placement-based viewing positions on operator performance in telepresence systems remains unknown. In this paper, we investigate the joint effects of depth-aiding augmentations and viewing positions on the quality of experience for operators in augmented telepresence systems. A study was conducted with 27 non-expert participants using a real-time augmented telepresence system to perform a remote-controlled navigation and positioning task, with varied depth-aiding augmentations and viewing positions. The resulting quality of experience was analyzed via Likert opinion scales, task performance measurements, and simulator sickness evaluation. Results suggest that reducing the reliance on stereoscopic depth perception via camera placement has a significant benefit to operator performance and quality of experience. Conversely, the depth-aiding augmentations can partly mitigate the negative effects of inferior viewing positions. However the viewing-position based monoscopic and stereoscopic depth cues tend to dominate over cues based on augmentations. There is also a discrepancy between the participants’ subjective opinions on augmentation helpfulness, and its observed effects on positioning task performance.

Assessing augmented reality in production: remote-assisted maintenance with HoloLens

Digitalisation provides many opportunities for process improvements by using smart devices such as Augmented-reality (AR) displays in production. Nevertheless, in-depth studies about the effects of these applications on key performance process indicators are sparse. The goal of this study is to evaluate AR-based remote maintenance processes supported by cutting edge optical head-mounted display technology. A total of 12 test runs conducted with real-world maintenance engineers in a real-world industry setting were analysed based on video recordings and semi-structured interviews. The study identified both case-specific and general issues, and the inherent potential of the technology.

Rethinking Maritime Education, Training, and Operations in the Digital Era: Applications for Emerging Immersive Technologies

The use of simulators in maritime education and training is an essential component for developing seafarer competencies. Emerging immersive technologies, such as virtual reality (VR), augmented reality (AR) and mixed reality (MR) have created new and differing possibilities for maritime simulations and simulators. The increasing advancements and technical readiness of these systems have paved the way for a new generation and category of simulators and simulation-based experiences for professional education, training, and operations, which are relatively cheaper, more immersive, compact, and accessible in comparison to traditional configurations. Although the concept of utilizing VR, AR, and MR head-mounted display technologies for professional training and operations is not new, their recent developments and proliferation now allow for practical implementation and real-world application. Particularly, the adoption and integration of these technologies into the education, training, and operations of maritime industries provide new possibilities and paradigms to support operators and operations both on land and at sea. The purpose of this paper is to discuss the concepts of VR, AR, and MR applications specifically for maritime education, training and operations, including the potential benefits, drawbacks, and limitations of these systems.